Inter-sentential Coreferences in Semantic Networks: An Evaluation of Manual Annotation
نویسندگان
چکیده
We present an evaluation of inter-sentential coreference annotation in the context of manually created semantic networks. The semantic networks are constructed independently be each annotator and require an entity mapping priori to evaluating the coreference. We present the model used for mapping the semantic entities as well as the algorithm used for our evaluation task. We present the raw statistics for inter-annotator agreement and describe the inherent difficulty in evaluating coreference in semantic networks.
منابع مشابه
Semi-Automatic Annotation of Intra-Sentential Discourse Relations in PDT
In the present paper, we describe in detail and evaluate the process of semi-automatic annotation of intra-sentential discourse relations in the Prague Dependency Treebank, which is a part of the project of otherwise mostly manual annotation of all (intraand inter-sentential) discourse relations with explicit connectives in the treebank. Our assumption that some syntactic features of a sentence...
متن کاملLarge-scale Semantic Networks: Annotation and Evaluation
We introduce a large-scale semantic-network annotation effort based on the MutliNet formalism. Annotation is achieved via a process which incorporates several independent tools including a MultiNet graph editing tool, a semantic concept lexicon, a user-editable knowledge-base for semantic concepts, and a MultiNet parser. We present an evaluation metric for these semantic networks, allowing us t...
متن کاملThe Effect of Intra-sentential, Inter-sentential and Tag- sentential Switching on Teaching Grammar
The present study examined the comparative effect of different types of code-switching, i.e., intrasentential,inter-sentential, and tag-sentential switching on EFL learners grammar learning andteaching. To this end, a sample of 60 Iranian female and male students in two different institutionsin Qazvin was selected. They were assigned to four groups. Each group was randomly assigned toone of the...
متن کاملSemantic-Based Image Retrial in the VQ Compressed Domain using Image Annotation Statistical Models
متن کامل
Building a Coreference-Annotated Corpus from the Domain of Biochemistry
One of the reasons for which the resolution of coreferences has remained a challenging information extraction task, especially in the biomedical domain, is the lack of training data in the form of annotated corpora. In order to address this issue, we developed the HANAPIN corpus. It consists of full-text articles from biochemistry literature, covering entities of several semantic types: chemica...
متن کامل